Bridging the gap between machine translation output and images in multimodal documents
نویسندگان
چکیده
The aim of this article is to report on recent findings concerning the use Google Translate outputs in multimodal contexts. Development and evaluation machine translation often focus verbal mode, but accounts by area exploration text-image relations documents translated automatically are rare. Thus, work seeks describe just what such how them, organized two parts: firstly, exploring problem through an interdisciplinary interface, involving Machine Translation Multimodality analyze some examples from Wikihow website; secondly, reporting investigation suitable tools methods properly annotate these issues within a long-term purpose assemble corpus. Finally, provides discussion findings, including limitations perspectives for future research.
منابع مشابه
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
Neural Machine Translation (NMT) is an end-to-end learning approach for automated translation, with the potential to overcome many of the weaknesses of conventional phrase-based translation systems. Unfortunately, NMT systems are known to be computationally expensive both in training and in translation inference – sometimes prohibitively so in the case of very large data sets and large models. ...
متن کاملSHEF-Multimodal: Grounding Machine Translation on Images
This paper describes the University of Sheffield’s submission for the WMT16 Multimodal Machine Translation shared task, where we participated in Task 1 to develop German-to-English and Englishto-German statistical machine translation (SMT) systems in the domain of image descriptions. Our proposed systems are standard phrase-based SMT systems based on the Moses decoder, trained only on the provi...
متن کاملBridging the gap: Thai - Thai Sign Machine Translation
We propose a multi-phase approach, Thai-Thai Sign Machine Translation (TTSMT), to translate Thai text into Thai Sign language. Thai Sign language is the language of the deaf in Thailand. TTSMT begins the translation process by segmenting the input sentence since Thai is a non-word boundary language, converting the segmented sentence into simple sentence forms since most Thai Sign are expressed ...
متن کاملBridging the Inflection Morphology Gap for Arabic Statistical Machine Translation
Statistical machine translation (SMT) is based on the ability to effectively learn word and phrase relationships from parallel corpora, a process which is considerably more difficult when the extent of morphological expression differs significantly across the source and target languages. We present techniques that select appropriate word segmentations in the morphologically rich source language...
متن کاملBridging the gap between sign language machine translation and sign language animation using sequence classification
To date, the non-manual components of signed utterances have rarely been considered in automatic sign language translation. However, these components are capable of carrying important linguistic information. This paper presents work that bridges the gap between the output of a sign language translation system and the input of a sign language animation system by incorporating non-manual informat...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Cadernos de Tradução
سال: 2021
ISSN: ['2175-7968', '1414-526X']
DOI: https://doi.org/10.5007/2175-7968.2021.e75483